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[57] ABSTRACT 

A video overlay system includes a bus device including a 
processor, a local memory, a video interface, and a DMA 
unit. A host computer passes to the processor the locations 
of one or more video windows in a graphics image, and the 
processor prepares a video pixel map in local memory which 
corresponds the size of the graphics image. The video pixel 
map has video data for one or more video images in the 
locations of the video window. The remainder of the video 
pixel map contains dummy values. The DMA unit moves 
pixel values from the local memory to the video interface, 
and the video interface provides the pixel values including 
both video data and dummy values to an encoder in syn- 
chronization with pixel values from another source which 
represent the graphics image. The encoder generates a video 
signal from pixel values representing the graphics image 
except when a key value occurs. When the key value occurs, 
the encoder uses a pixel value from the video interface in 
place of the key value. 

11 Claims, 7 Drawing Sheets 
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VIDEO INTERFACE AND OVERLAY pixel map, contains video data representing one or more 

SYSTEM AND PROCESS video images to be displayed and dummy (or "don't care") 

data to be discarded. The video data is positioned in the 

BACKGROUND OF THE INVENTION video pixel map at the same locations as chroma key values 

. 5 in the graphics pixel map. A video encoder which generates 

1. Field of the Invention a videQ signaj fof a monilor or other vi deo display uses pixel 

This invention relates to processes and systems for insert- values from the graphics pixel map unless the pixel value 

ing a video image into a graphics image when generating a from mc graphics pixel map is the chroma key. If the 

video signal. graphics pixel value is equal to the chroma key, the video 

2. Description of Related Art 10 encoder uses a pixel value which is from the video pixel map 
Conventional computer systems generate pixel maps to ana " at the same relative position as the graphics pixel value 

represent graphics images. A pixels map is a two dimen- being replaced, 
sional array of pixel values where each pixel value indicates 
a color for a corresponding pixel (area) on a monitor or other 

video display. A video encoder generates an output video 15 FIG. 1 is a block diagram of a multimedia device which 

signal from the pixel values in a pixel map, and a monitor performs a video overlay process in accordance with an 

displays the image represented by the video signal. For the embodiment of invention. 

image to have the proper appearance, the rows and columns pic. 2 is a block diagram of a multimedia signal proces- 

of the pixel map must be synchronized or matched with ^ f or me device of FIG 1 

portions of the output video signal that are associated with 20 na 3 fc a Wock q{ aQ ^ for tQe 

the same rows and columns on the monitor so that each pixe multimedia signal proC essor of FIG. 2. 

is displayed with the color identified by an associated pixel M „ • . . 

vaiuc FIG. 4 is a block diagram illustrating the organization of 

' f . ... a video interface in accordance with an embodiment of the 

Video overlay systems can insert into a graphics image a invention 

video image such as might be generated by a television 25 m „ e . -j • 

tuner, a video camera, VCR, or a video decoder. Video ™i. 5 is block diagram of registers m a video interface 

overlay systems commonly include software that generates and circuitryfor accessing registers in a video encoder and 

a pixel map representing the graphics image and provides in a vldeo decoder. 

the graphics image a video window which is filled with a FIG - 6 is a block diagram of a data path through a video 

color (or chroma) key. A separate device such as a video 30 interface to a video encoder. 

capture card generates the video image. In one type of FIG. 7 illustrates graphics and video pixel maps generated 

system, an analog video signal represents the video image; in accordance with an embodiment of the invention, 

and when converting the pixel map representing the graphics u se of the same reference symbols in different figures 

image to an output video signal, an overlay system recog- indicates similar or identical items, 
nizes the chroma key and inserts the analog video signal in 

place of a signal representing the chroma key. When the DETAILED DESCRIPTION OF THE 
graphics signal no longer represents the chroma key, the PREFERRED EMBODIMENTS 
output signal switches back to the video signal generated for In accord ance with an aspect of the invention, a video 
the graphics image. In this type of overlay system, proper overlay system ^ ^ Q pixel maps of me Mmc size Qne 
synchronization of the inserted video signal in the graphic kel which fe referred to herein ^ the graphics pixel 
video signal can be difficult to achieve. An alternative map , represents a grapriics image and contains one or more 
overlay system generates pixel maps representing frames of video ^^ws each of which is filled with a chroma key. 
the video image to be displayed in the video window. The Xhe pixel mapj referred tQ herein ^ the video pixel 
pixel maps for the video image contain rows and columns of map> video data presenting one or more video 
pixels matching the area of the video window. When a video ^ t0 be displayed and dummy data to be discarded, 
encoder encounters in the pixel map for the graphics image T ... . , , . , 
. . A iL L , f ■ i i « In one embodiment, a bus device that is attached to a host 
a pixel value matching the chroma key, that pixel value is , * i j • i . n 
r . . i i • i i r lL - i r .l -j computer includes a signal processor which executes sort- 
replaced with a pixel value from the pixel map for the video \ 4 -T • i a l . mi i 
. r r r v ware to construct the video pixel map. A host CPU executes 

1111 a £ e * 5 0 driver for the device and indicates the position of the video 

Both of the above overlay systems encounter diflBculties windows in the graphics image so that the signal processor 

when inserting multiple video images into multiple video can positiorj tne vi deo data in the video pixel map at the 

windows in the graphics image. For multiple video same i ocat i 0 ns as chroma key values in the graphics pixel 

windows, the overlay system must select from among mul- map a video encoder on the device generates a video signal 

tiple video signals or pixel maps each time a color key is 55 for a momtor or otner ^0 display. The video encoder uses 

encountered. In particular, the overlay system must match pixel values from the graphics pixel map unless a pixel value 

each video window with the video signal or video pixel map from ^ graphics pixel map has the chroma key value. If the 

corresponding to the video window. Matching windows and graphics pixel value has the chroma key value, the video 

video images can be prohibitively complex. encoder uses a pixel value which is from the video pixel map 

ct T\jf aji a dv nc -rue iM\^wnnM 60 and al the same relalive position as the graphics pixel value 

SUMMARY OF THE INVENTION ^ replaced y{dcQ ^ be 

In accordance with an aspect of the invention, a video without difficulty because video data is already correctly 

overlay system uses two pixel maps of the same size. One positioned in the video pixel map. 

pixel map, which is referred to herein as the graphics pixel FIG. 1 shows an embodiment of a multimedia device 100 

map, represents a graphics image and contains one or 65 capable of implementing a variety of multimedia operations 

multiple video windows, each of which is filled with a color including an overlay process in accordance with an embodi- 

key. The second pixel map, referred to herein as the video ment of the invention. Device 100 connects to a PCI bus 140 
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of a host computer (not shown) and includes a multimedia tions. The real-time operating system allows multitasking 
signal processor (MSP) 200 and a local memory 180 which for simultaneous execution of software for multiple func- 
stores data and instructions for MSP 200. The host computer tions. Processor 210 also controls initialization, starting, and 
and device 100 execute separate programs which co-operate stopping of vector processor 220. Vector processor 220 
to perform desired multimedia functions. With the appro- 5 performs number crunching including repetitive operations 
priate software for MSP 200, device 100 can perform on i arge <j a ta blocks that are common in multimedia pro- 
functions including: video capture; digital video to NTSC or cessing 

PAL signal conversion; JPEG, MPEG I, and MPEG II D „ ft , „ A . . . , 

encoding and decoding; video image overlay into a graphics u *°cessors 210 and ^0 communicate with each other 

image; graphics card emulation; FM and wavetable sound in through duect hues 212 214, and 216 or through shared 

synthesis; facsimile and modem communications; sound 10 extende < rc f ters 21 u 8 " ™ "d 220 commum- 

card emulation; and video conferencing. cate with other on^hip components through a cache sub- 

r- . « inn • i j -j system 230 which contains an instruction cache 262 and a 

For video processing, device 100 includes a video /. , - £A e ~- ft , . , , 

• j ha l- i_ u ji • . *j * ■ data cache 264 for processor 210 and an instruction cache 

decoder 110 which handles mput video signals to be pro- , , 4 . / 4 . j-,, or t « A 

, , wori ^ Art j -j j u- u ^ 266 and data cache/scratch pad 268 for vector processor 220. 

cessed by MSP 200 and a video encoder 130 which converts 1( - „ , . , ' . *. , , d^x* u <™ a 

. , . / 4 . 4 . - . , • • . * 15 Cache subsystem 230 also includes a ROM cache 270 and 

v,deo ^formation to a video signal or a televKion or a v,deo ^ ^ ^ em m ^ 

monitor A separate video card (no shown) supplies graph- ^ statioQ fo/precMor 2 i 0 , processor 220, and on-chip 

ics data to video encoder 130 via a feature connector 120. In , & . , /. . «n ^nn ne * . i- 

... . f . , ., Af11 devices coupled to busses 240 and 250. U.S. patent apph- 

one embodiment, feature connector 120 follows an mdustry ca(ion ^ * 0 8/697,102 and 08/733,813 further describe 

standard interface implemented by video card manufactures , n c . , -- n 

r t - . *. , t r J w - A . , , Xjfen 20 operauon of a cache subsystem 230. 

for transferring graphics data from VGA video cards. MSP r J t 

200 generates video data, for example, by executing soft- Bus 240 wnich » sometimes referred to herein as IOBUS 

ware for JPEG, MPEG I, or MPEG II decoding, by decoding 240 connects to on-chip devices such as a system timer 242, 

a video signal from a telephone line, or by processing video a UART (universal asynchronous receiver transceiver) 244, 

data from video decoder 110. Video encoder 130 generates 2$ a hitstream processor 246, and an interrupt controller 248. 

an analog video signal for a television, monitor, or other Bus 250, sometimes referred to herein as FBUS 250, 

video display by decoding pixel values in an overlay process operates at a higher clock frequency than bus 240 and is 

which can combine video data from MSP 200 and with the connected to on-chip devices such as an ASIC interface 251, 

graphics data from feature connector 120. a host interface 256, and a memory controller 258. Memory 

An audio/communications codec 150 which performs 30 controller 258, host interface 256, and ASIC interface 251 
analog-to-digital and digital-to-analog conversions creates a respectively provide interfaces for local memory 180, the 
bridge between MSP 200 and analog systems such as an host computer, and external integrated circuits such as video 
audio input/output amplifier 160 and a data access arrange- decoder 110, video encoder 130, and codec 150. ASIC 
ment (DAA) circuit 170. For example, when the host interface 251 includes a video interface 252, an audio/ 
computer sends appropriate data or commands to device 100 35 communications interface 254, and a DMA controller 255. 
via bus 140, MSP 200 executes sound card emulation Vlde0 interface 252 communicate with video decoder 110 
software which implements sound generation techniques a °d video encoder 130, and an audio/communications inter- 
such as FM or wavetable synthesis as requested by the host face 254 communicates with codec 150. DMA controller 
computer. Execution of the sound card software generates 255 controls DMA (direct memory access) operations 
sound samples which codec 150 converts to an analog audio 40 between local memory 180 coupled to memory controller 
signal. 258 and devices coupled to video interface 252 and codec 

For communications processing, codec 150 digitizes an interface 254. DMA operations can proceed without inter- 
analog communication signal derived from a telephone line vention from processor 210 or 220. 
and passes the digitized signal through MSP 200 to local FIG. 3 illustrates the organization of an embodiment of 
memory 180. MSP 200 executes modem, facsimile, or 45 ASIC interface 251. In this embodiment, DMA controller 
videophone software to demodulate, decompress, and oth- 255 is illustrated as two blocks an FBUS interface block 310 
erwise extract data from the digitized signal. For transmis- and a glue logic and DMA control block 320. FBUS 
sion of data on telephone lines, MSP 200 receives data from interface block 310 implements the protocol necessary to 
the host computer and generates a sequence of samples transfer data on FBUS 250. FBUS 250 is a shared bus which 
representing an analog signal according to a protocol for 50 is coupled to cache subsystem 230, DMA controller 255, 
. conveying the data. Codec 150 converts the samples to an host interface 256, and memory controller 258 as indicated 
analog signal which is transmitted through DAA circuit 170. above in regard to FIG. 2. To transfer data via FBUS 250, 

FIG. 2 shows a block diagram of the exemplary embodi- DMA controller 255 requests access to FBUS 250 with 

ment of MSP 200. MSP 200 is an integrated multiprocessor memory controller 258 as a target device. A bus arbiter (not 

which includes a general-purpose processor 210 and a vector 55 shown) grants access according to current use of FBUS 250 

processor 220. In an exemplary embodiment of the and priority of devices requesting access. The arbiter signals 

invention, processor 210 implements the ARM7 architecture memory controller 258 to be ready when the arbiter grants 

and instruction set described in the "ARM7DM Data Sheet", bus access to DMA controller 255. U.S. patent application 

Document Number: ARM DDI 0010G which is available Ser. No. 08/731,393 describes a suitable bus protocol for 

from Advance RISC Machines Ltd.; and vector processor 60 raus 250 - Table A* 3 describes the signals employed by 

220 implements the instruction set described in U.S. patent FBUS interface 310. Alternative bus interfaces and proto- 

application Ser. No. 08/699,597. Processors 210 and 220 cols for FBUS interface 310 and FBUS 250 are well known 

execute separate program threads and are structurally dif- in the art. 

ferent for more efficient execution of particular tasks. Pro- DMA control block 320 provides eight DMA channels 

cessor 210 executes a real-time operating system, exception 65 which are assigned to up to eight codec interfaces 330 to 

routines for both processors 210 and 220, and general 337. Each codec interface 330 to 337 is adapted for a specific 

processes not requiring large numbers of repetitive calcula- type of external device which uses the associated DMA 
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channel. Although referred to herein as codec interfaces, decoder 110. For a KS0119 or KS0122, the interface is a 

interfaces 530 to 337 can more generally be adapted to three -wire serial interface. A signal SCLK controls the rate 

external devices not limited to codecs. In the exemplary of data transfer. Signal SFRS indicates a frame sync signal 

embodiment, channel 0 and codec interface 330 are for for frames of data transferred according to the protocol 

video encoder 130 which is a KS0119 video encoder avail- 5 defined for the KS0119 encoder. 

able from Samsung Electronics Co., Ltd. DMA channel 2 FIG. 5 shows a block diagram of video control interface 

and codec interface 332 are for video decoder 110 which is 430 with the addition of the register set of video interface 

a KS0122 available from Samsung Electronics Co., Ltd. 452. Data for configuring and reading registers is passed via 

DMA channels 4, 5, 6, and 7 are for digital-to-analog and DMA channel 0 for video encoder 130 and via DMA channel 

analog-to-digital converters in an audio/communications 1Q 2 for video decoder U0. Video interface 252 includes 

codec 150 which is an AD1843 available from Analog registers 501 to 515 which are loaded with values that 

Devices, Inc. Channels 1 and 3 are unused in the exemplary control operation of video interface 252 and which control 

embodiment. access to control registers in video encoder 130 and video 

In addition to access via FBUS 250, DMA control block decoder 110. Tables A.4 and A.5 list the register set for the 

320 has direct access to memory controller 258 via a bus exemplary embodiment of video interface 252, Each register 

carrying an address signal ref_addr and a control Signal has m address in the address of M$p 200 To ^ tQ 

addr_yahd. When signal addr_valid is asserted memory of ^ 5Q1 {Q sn cesSQ[ 210 addresses data t0 

controller 258 queues a priority read operaUon of the size J addr 4 ^spending to the desired register, and cache 

requested by DMA controller 255. These priority reads arc . , . & . „ & - ' . 

handled before DMA requests via FBUS 250 Memory ^ ^ s ' em ™ ^ acce! f s ™^ stroller 255 via FBUS 

controller 258 asserts a signal data_valid to codec interface 20 2 f After handshaking mrough codec request and acknowl- 

330 when data is ready and a signal ref_dat indicates a ed S es S1 8 nals for tne appropriate channel, DMA control 

64-bit value read from local memory 180. Signals ref_addr generates a signal Crd_wrl identifying the register and data 

and ref__dat bypass FBUS 250 to provide a data transfer sl S nal t0 ^ written. A state machine 530 controls a multi- 

without competition for access to FBUS 250. U.S. patent P lexer 540 wnicn selects the source of input data (C0_data 

application Ser. No. 08/730,915 describes circuitry and a is or C2— data ) and causes the selected register to store the 

process for memory controller 258 to rapidly transfer video data. Registers 507 to 512 and a multiplexer 515 implement 

data for screen refresh operations. the protocol for accessing control registers in video encoder 

FIG. 4 shows a block diagram of video interface 252 130 and video decoder 110 and are described in the Appen- 

which implements the functions of codec interfaces 330 and dix. 

332 of FIG. 3. Video interface 252 includes a video encoder 30 FIG. 6 is a block diagram of the data path through video 

interface 410, a video decoder interface 420, and a video interface 252 to video encoder 130. Video data is provided 

control interface 430. Video encoder interface 410 provides to video interface 252 through a direct line carrying 64-bit 

a data signal PD[15:0] representing pixel values to video data signal ref_dat. Using a direct bus to memory controller 

encoder 130. Video interface 410 receives a horizontal 258 avoids time delays possible on shared bus 250 and 

synchronization signal BGHS, a vertical synchronization 35 allows fast access to video data for a screen refresh. Data 

signal BGVS, and a clock signal BGCLK which video represented by signal ref_dat is initially stored in a buffer 

encoder 130 uses when decoding pixel values to generate a 610 before being transferred through a de-multiplexer 620 to 

video signal. A signal MSSEL selects the operating mode of a FIFO buffer 630 or a FIFO buffer 635. A display state 

video encoder 130. In a VGA emulation mode, video machine 670 is coupled to FIFO buffers 630 and 635, and 

encoder 130 decodes only pixel values from video interface ^ when either of the FIFO buffers is empty requests a DMA 

410, and MSP 200 executes software to emulate a VGA transfer to the empty buffer while data from the other FIFO 

graphic card. In an overlay mode, video encoder 130 uses buffer is transmitted to video encoder 130. Synchronizers 

graphics data from feature connector 120 and overlays video 680 and 685 communicate control signals between display 

windows with video data from video interface 410. state machine 670 and a DMA state machine 660 which 

Video encoder interface 410 also implements an interface 45 requests the DMA transfer and controls de-multiplexer 620 

to external ROM (not shown) which stores start-up firmware to route data to the appropriate FIFO buffer 630 or 635. 

for processor 200. When a signal PROMCS# is asserted low, Display state machine 670 controls a multiplexer 640 

signal PD[15:0] indicates an address for the external ROM, which selects FIFO buffer 630 or 635 as the source of video 

and a data signal PROM_DATA[7:0] is returned from the data. Video data is transferred 64 bits at a time via signal 

PROM to video interface 410. Processor 210 controls trans- 50 ref_data into buffer 610 and through FIFO buffers 630 and 

fer of ROM data via the DMA data bus and FBUS 250 to 635 and multiplexer 640. A formatter 645 divides the 64-bit 

local SDRAM 180 during initialization. data according to the appropriate size for pixel values. For 

Video decoder interface 420 receives signals Y[7:0] and example, the exemplary embodiment of the invention sup- 

C[7:0] representing pixel values from video decoder 110. In ports 16-bit, 8-bit, and 4-bit pixel value formats so that one 

one embodiment, signals Y[7:0] and C[7:0] represent pixel 55 64-bit data transfer provides four, eight, or sixteen separate 

values in a 16-bit YCrCb 4:2:2 format, but other pixel value pixel values. A serialize r 650 transmits one pixel value at a 

formats could be employed. Video decoder interface 420 time via signal PD[15:0]. 

also receives a vertical synchronization signal VS, a hori- Display state machine 670, multiplexer 64, formatter 645, 

zontal synchronization signal HS, and clock signals CK and and serializer 650 operate according to a pixel clock signal 

CK2 which are control signals used in forming pixel maps. 60 BGCLK from video encoder 130 to properly synchronize 

A DMA operation stores video data from video decoder 110 pixel values. Display state machine 670 uses vertical and 

in local memory 180 where the data is available to MSP 200. horizontal synchronization signals BGVS and BGHS to 

MSP 200 can, for example, uses the video data to generate synchronize DMA operations from a pixel map in local 

a pixel map for an overlay operation such as described memory with video decoding. In response to the vertical 

below. 65 synchronization signal BGVS, display state machine 670 

Video control interface 430 provides an interface for begins transfer of data from the beginning of a pixel map; 

accessing control registers in video encoder 130 and video and in response to the horizontal synchronization signal 
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BGHS, display state machine 670 begins transfer of data 
from the beginning of a row in the pixel map. In one 
embodiment of the invention, FIFO buffers 630 and 635 are 
large enough to hold a line of video data, and each DMA 
request is for a full line of video data. When signal BGHS 5 
is asserted, display state machine 670 switches from a FIFO 
630 or 635 which was providing video data to a FIFO 635 
or 630 which provides a new line of data. 

FIG. 7 illustrates pixel maps used in an overlay processes 
in accordance with an embodiment of the invention. Pixel 10 
map 710 is a video pixel map generated by MSP 200 and 
stored in local memory 180. Pixel map 710 includes dummy 
data 715 and blocks of video data 711, 712, and 713. The 
value of the dummy data is unimportant since the dummy 
data value is unused. However, the dummy data acts as a 35 
place holder to define the locations of video data 711 to 713. 
Each block of video data represents a frame in a video image 
to be overlaid on a graphics image. Video data blocks 711, 
712, and 713 can be from one or multiple sources including 
a video camera or television tuner which is coupled to video 2 q 
decoder 110, a communications signal which originated on 
a telephone line connected to DAA 170, or data supplied by 
the host CPU in a coded format such as JPEG, MPEG I, or 
MPEG II which MSP 200 decoded to generate pixel values. 
Graphics pixel map 720 represents the graphics image and 25 
contains video windows 721, 722, and 723 which are filled 
with a color key value. A single color key value can be used 
for all of the video windows since separate color keys are not 
required for distinguishing different video windows. 

MSP 200 executes software to construct video pixel map 30 
710 in a frame buffer in local memory 180. Two or more 
pixel map buffers may be employed so that MSP 200 can 
construct pixel maps for future video frames while a current 
pixel map is being used to generating a video signal. Before 
constructing pixel map 710, MSP 200 obtains the locations 35 
and sizes of video windows 721, 722, and 723 from a driver 
executed by the host CPU, and when constructing pixel map 
710 fits video data blocks 711, 712, and 713 into the same 
shapes occupied by video windows 721, 722, and 723. 
Typically, each video window 711 to 713 is a rectangle, and 40 
the video data 711 to 713 have pixel values in rows and 
columns which match the size of the associated video 
window. 

For the overlay process, processor 210 sets an HS, VS 
polarity register 501 so that video interface 252 recognizes 45 
assertion of vertical sync signal BGVS and horizontal sync 
signal BGHS. HS offset register 502 and VS offset register 
503 are set to indicate an offset in clock cycles between 
assertion of signals BGVS and BGHS and the first required 
pixel value for a video frame or row in a video frame. A 50 
DMA transfer address in local memory 180 is set to the 
frame buffer corresponding to the next video frame which 
MSP 200 previously prepared. A bit DMAENA in logic 
control register 540 is then set to enable the start of DMA 
operations which load video data from the selected frame 55 
into FIFO buffers 630 and 635. Display state machine 
synchronizes the start of video transfer for the frame with the 
vertical synchronization signal BGVS and transfers one 
pixel value to video encoder 130 for each cycle of pixel 
clock BGCLK. 60 

While MSP 200 is transferring pixel values to video 
encoder 130, video encoder 130 is also receiving pixel 
values through feature connector 120. When signal MSSEL 
indicates overlay mode operation, video encoder 130 selects 
and uses the pixel value from feature connector 120 unless 65 
that pixel value has the color key value. Video encoder 130 
discards or ignores the pixel values from video interface 



252, which should be dummy values, when decoding pixel 
values from the feature connector 120. If the pixel value 
from feature connector 120 has the color key value, video 
encoder 130 uses the pixel value from video interface 252. 
Since MSP 200 constructed video pixel map 710 to have the 
video data block 711 to 713 in the same locations as video 
windows 721 to 723 in graphics pixel map 720, video data 
replaces the color key values and video images are auto- 
matically displayed in the correct video window. While 
video encoder 130 generates the video signal for the current 
frame of a video, MSP 200 constructs in a second video 
buffer another pixel map for the next or a future video frame. 

If signal MSSEL selects VGA emulation mode, video 
encoder 130 decodes only the pixel values from video 
interface 252. MSP 200 generates pixel maps as described 
above except that MSP 200 generates pixel values repre- 
senting a graphics image in place of dummy data 715. Video 
interface 252 transfers the video data in the same manner as 
described above. According, device 100 of FIG. 1 could be 
used for an overlay process as describe above with a separate 
graphics card, or without a graphics card where MSP 200 
implements the functions necessary to emulate a graphics 
card. 

Although the invention has been described with reference 
to particular embodiments, the description is only an 
example of the invention's application and should not be 
taken as a limitation. Various adaptations and combinations 
of features of the embodiments disclosed are within the 
scope of the invention as defined by the following claims. 

CROSS-REFERENCE TO RELATED 
APPLICATION 

This patent document is related to and incorporates by 
reference the following: 

U.S. patent application Ser. No. 08/697,102, entitled 
"MULTIPROCESSOR OPERATION IN A MULTI- 
MEDIA SIGNAL PROCESSOR", filed Aug. 19, 1996; 

U.S. patent application Ser. No. 08/699,597, entitled 
"SINGLE-INSTRUCTION-MULTIPLE-DATA PRO- 
CESSING IN A MULTIMEDIA SIGNAL 
PROCESSOR", filed Aug. 19, 1996; 

co-filed U.S. patent application Sen No. 08/733,813, 
entitled "RESIZABLE AND RELOCATABLE 
MEMORY SCRATCH PAD AS A CACHE SLICE"; 

co-filed U.S. patent application Ser. No. 08/733,913, 
entitled "PCI INTERFACE SYNCHRONIZATION"; 

co-filed U.S. patent application Ser. No. 08/730,864, 
entitled "SERIAL CODEC INTERFACE"; 

co-filed U.S. patent application Ser. No. 08/731,393, 
entitled "SHARED BUS SYSTEM WITH TRANSAC- 
TION AND DESTINATION ID"; and 

co-filed U.S. patent application Ser. No. 08/730,915, 
entitled "A PRIORITY REQUEST AND BYPASS 
BUS". 

APPENDIX 

This appendix describes an exemplary embodiment of 
ASIC interface 251. ASIC interface 251 contains a program- 
mable 32-bits DMA controller 255 and codec interface 
blocks 330 to 337 and provides an interface between the 
main system bus (FBUS 250) which is running at 80 MHz 
and devices such as an AD1843 codec for audio telephone, 
a KS0122 video decoder for video capture, a KS0119 video 
encoder for overlay and VGA emulation. CODEC interfaces 
330 to 337 and DMA controller 320 run at full FBUS speed 
to avoid synchronization problems. 
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ASIC interface 251 has three major sections: Fbus master/ 
slave interface 310, 8-channel DMA controller 320, and 
codec interfaces 330 to 337. Data flows from FBUS 250 to 
external devices connected to codec interfaces 330 to 337 
and visa versa. However, only DMA controller 320 gener- 5 
ates an address for DMA operations. This address is then 
mapped in fbus interface logic 310. All writes from other 
FBUS nodes program the registers in the CODEC section. 

ASIC interface 251 has the following features: 32-bits 
basic DMA function with 8 channels; two 4-deepx64-bit 10 
data FIFOs; one l-deepx52-bit REQUEST FIFO; one 
2-deepx52-bit REPLY FIFO; master/slave control for FBUS 
250 and CODEC interface blocks at FBUS frequency of 80 
MHz; internal arbitration for eight CODEC interfaces with 
the highest priority for KS0119 video encoder, 10 to 
MEMORY and MEMORY to IO access; support for 
CODEC initialization; and a special address bus to achieve 
high performance for video encoder 130. 

The codec interfaces support three different CODECs: an 
(AD 1843) audio/communications codec 150 through a bidi- 
rectional 64-bit data bus that communicates with the DMA 
controller via channel 4 for DAC1, channel 5 for DAC2, 
channel 6 for ADC Left, and channel 7 for ADC Right; a 
(KS0122) video capture codec 110 through a bidirectional 
64-bit data bus and is capable of initiating memory to IO and 
IO to memory requests to the DMA(Channel 2); a (KS0119) 
Video Backend codec 130 which receives data from the 
Memory Controller 258 directly. 

DMA controller 255 has registers for address generation 
and translation and eight independent channels. Each chan- 
nel has a current address register and a stop address register. 
A current address register is loaded whenever one of the 
eight CODEC'S asserts a DMA request. When FBUS 250 
grants bus access, the current address register increments 
each cycle until the current address register matches the stop 
address register. At that time, DMA controller 255 generates 
a signal "EOP" (End of process) which causes an interrupt. 

DMA controller 255 supports IO to MEMORY, 
MEMORY to IO, and MEMORY to MEMORY access. 
Whenever a CODEC interface needs access to DMA control, 
the codec interface asserts a DMA^REQ signal and waits 
for DMA controller 255 to acknowledge "DACK". All eight 
DMA channels have a common arbitration unit which con- 
trols multiplexers and address comparison blocks. When 
acknowledged, the codec interface drives control signals and 
data. DMA controller 255 selects the appropriate channel 
depending on the DMA__ACK granted. 

DMA controller 255- has a register set that processor 210 
can access. In the exemplary embodiment, DMA controller 
255 includes the following registers. 

Each DMA channel has a 29-bit current address register 
(bits <31:3>) which requires all addresses to be 8-byte 
aligned. The current address register is a 29-bit counter 
which processor 210 can read. Processor 210 can load an 55 
initial value through FBUS 255 to the current address 
register. The current address value is incremented based on 
the data transfer size. The address in the current address 
register is sent to an address generation block to load the 
address on FBUS 250 through a multiplexer. The current 60 
address register holds the address value during idle state. 

Each channel has a 29-bit stop address register (bits 
<31:3>) which requires all addresses to be 8-byte aligned. 
Processor 210 can write the Stop Address register through 
FBUS 250. A comparison block in DMA controller 255 65 
compares the stop address values with current addresses. If 
a current address value matches an associated stop address 



20 



25 



30 



35 



40 



value, DMA controller 255 generates a signal "EOF' for the 
associated channel. 

The DMA status register indicates whether each channel 
has reached the stop address value. Bits <7:0> specify which 
channels have reached the stop address value and are reset 
if processor 210 initializes the current address register 
through CCU 230. Processor 210 can read but not write the 
DMA status. 

The DMA control register contains control information 
for the operation of DMA controller 255. Bits <7:0> specify 
which DMA channel is enabled for operation and are reset 
whenever a corresponding channel reaches at a stop address. 
Processor 210 can set the DMA control register to restart 
operation. If any channel enable bit is "0", DMA controller 
255 will not acknowledge (i.e. assert signal DMA^ACK to) 
a corresponding CODEC interface even if the CODEC 
interface sends signal DMA^_REQ. Bits <19:16> of the 
DMA control register specify which pair of DMA channels 
are linked together to act as a double-buffer. For example, if 
channel 0 and channel 1 are linked together as a double - 
buffer, DMA controller 255 automatically switches to chan- 
nel 1 when the current address of channel 0 reaches it's stop 
address and switches to channel 0 when the current address 
of channel 1 reaches it's stop address. Bits <28:21> contain 
information regarding a read/write mode for each channel. If 
processor 210 sets any bit of Bits <28:21> to "1", the 
corresponding channel is used for READ operation. Others 
channels are for WRITE operations. Bit <31> specifies 
whether DMA controller 255 sends signal EOP to interrupt 
controller 248. If bit <31> is "0", DMA controller 255 does 
not send signal EOP when a channel reaches the stop 
address. 

Each bit in the control register has an associated mask bit 
in the mask register. A mask bit being "0" prevents updates 
of the corresponding bit in the control register. Initially, the 
mask register <31:0> is set to FFFF FFFFh. 

Processor 210 programs the start and stop address through 
FBUS 250. FBUS 250 mapped values are as follows: 

Cache Control Unit — 0040_0000-007F_FFFF; 
Memory Control unit ->0080_0000-047F__FFFF; 
PCI — 0800_0000-FFFF_FFFF; and 
as shown in Table A.l. 
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TABLE A. 1 




DMA Register Address Map 


Address Offset 


#of 




<26:0> (hex) 


Bits 


Description 


4A0_0000 


29 


Current Address Register 0 


4A0_0008 


29 


Current Address Register 1 


4A0„0010 


29 


Current Address Register 2 


4A0_0018 


29 


Current Address Register 3 


4A0_0020 


29 


Current Address Register 4 


4A0_0028 


29 


Current Address Register 5 


4A0_0O30 


29 


Current Address Register 6 


4A0_0038 


29 


Current Address Register 7 


4A0_004O 




Reserved 


4A0_0048 




Reserved 


4AO_0050 


29 


Stop Address Register 0 


4A0_0058 


29 


Stop Address Register 1 


4AO__0060 


29 


Stop Address Register 2 


4A0_0068 


29 


Stop Address Register 3 


4A0_0070 


29 


Stop Address Register 4 


4AQ__0078 


29 


Stop Address Register 5 


4A0_0080 


29 


Stop Address Register 6 


4A0_0088 


29 


Stop Address Register 7 


4A0_0090 




Reserved 
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TABLE A. 1 -continued 





DMA Register Address Map 


Address Offset 


#of 




<26:0> (hex) 


Bits 


Description 


4A0_0098 




Reserved 


4A0_00A0 


32 


Status Register 


4A0_00A8 


32 


Control Register 


4A0_00B0 


32 


Mask Register 



Processor 210 initializes the CODECs through ASIC 
interface 251. ASIC interface 251 has an address decoder to 
generate a request signal for each CODEC. Whenever ASIC 
interface 251 needs to access any CODEC, ASIC interface 
251 sends a request signal CODEC_REQ to the codec 
interface and waits for an acknowledge signal CODEC_ 
ACK from the codec interface. After receiving the acknowl- 
edge signal, ASIC interface 251 sends data and address to 
the codec interface. 

When processor 210 wants to read configuration data in 
any codec interface, CCU 230 access ASIC interface 251 
through FBUS 250 and provides an address and a transac- 
tion ID. ASIC interface 251 sends the address to the codec 
interface. ASIC interface 251 sends TRANSACTION ID 
and configuration data back to CCU 230 upon receiving the 
data from the CODEC. Table A.2 shows an address map for 
configuration registers in the codec interfaces. 



10 



is 



20 



TABLE A.2 



CODEC Configuration Register Address Map 



Address <31:0> (hex) 



Description 



04B0_0000 
04CO_1000 
04CO_2000 
04CO_3000 
04CO_4000 
04CO_5000 
04CO_6000 
04CO_7000 
04CO_8D00 
04CO_9000 



to 04BF_FFFF 
to 04CO_1FFF 
to 04C0_2FFF 
to 04C0_3FFF 
to 04C0_4FFF 
to 04C0_5FFF 
to 04C0_6FFF 
to 04C0_7FFF 
to 04C0_8FFF 
to 04C0_9FFF 



CODEC0 Configuration 
CODEC1 Configuration 
CODEC2 Configuration 
CODEC3 Configuration 
CODEC4 Configuration 
CODECS Configuration 
CODEC6 Configuration 
CODEC7 Configuratioh 
Reserved 
Reser\'ed 



Register 
Register 
Register 
Register 
Register 
Register 
Register 
Register 



TABLE A3 



Signal Name 


Dir 


clkl 


in 


f_reset_J 


in 


Fasc_grant_l 


in 


Fasc_cs_l 


in 


C0_size[7:0]- 


in 


C9_size[7:0] 




DMA_REQO- 


in 


DMA_REQ7 




CODEC_ACK0- 


in 


CODEC_j\CK7 




ref._full 


in 


FdrdyJ 


in/ 




out 


Fdata[63:0] 


in/ 




out 


Faddr[31:0] 


in/ 




out 



I/O Signals for the ASIC interface 



Description 



80 MHZ system clock input 
Fbus reset-signal (Low active) 
Fbus grant from Fbus Arbiter for ASIC 
unit(Low active) 

ASIC chip select signal (Low active) 
CODEC data transfer size: 81108 -> 8 
bytes, 8'h20 -> 32 bytes, 8*hl8 -> 24 
bytes, 8'h20 -> 32 bytes 
DMA request signals come from CODECs 

CODEC acknowledge signals come from 
CODECs 

FIFO used for screen refresh full 
signal (comes from the MCU) 
Fbus data ready signal, valid one 
cycle before actual data. 
Fbus data 

Fbus address 
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Signal Name 


Dir 


Freq_JD[9:0] 


in/ 






Freq_size[7:0] 


in/ 






Frd_wr_l 


in/ 




out 


Fpr_wr_l 


in/ 




out 


C0_DATA|63O}- 


in/ 


/tq riATAffiHYl 

i_y uf\±f\\ aj ruj 


out 


Fasc_dfull 


out 


Fact nfiill 


out 


Fasc_grCNT 


out 






Fasc_did[2:0] 


out 


Fasc recl_ 1 




CODEC 


out 


ADDR[31:0] 




DMA_ACK0- 


out 


DMA_>\CK7 




Crd_wr_l 


out 


CODEC_REQ0- 


out 


CODEC_REQ7 




EOP 


out 


Ref_addr[31:0] 


out 


addr_valid 


out 


Fmem_grant_l 


in 



Dir Description 



Fbus request ID: [9:6] -> requester 
ID, [5:0] -> Transaction ID 
Fbus data transfer size 

Read/Write indication: "1" -> read, 
"0" -> write 

Partial write indication (Low active) 
CODEC data 

ASIC unit data FIFO full, (goes to 
Fbus arbiter) 

ASIC unit reply FIFO full(goes to 
Fbus arbiter) 

Fbus grant counter which is valid 
with request to indicate the number 
of cycles grant is needed for(goes to 
Fbus arbiter) 

Fbus destination ID to request from 
ASIC unit 

Fbus request signal from ASIC 
unit(Low active) 

CODEC address which are only used for 
codec configuration register 
read/write(goes to CODECs) 
DMA acknowledge signals(goes to 
CODECs) 

Read/Write indication for codec 
configuration register access. 
CODEC request signals 

End of Process. This signal goes to 
interrupt controller. 

Address for CHANNEL0(goes to the MCU) 
Chan dc 10 address valid signal (goes to 
the MCU) 

MCU giant signal comes from FBUS 
arbiter 



Video interface 252 includes a control interface for access 
to all registers inside the KS0119 and the KS0122 codecs. A 
three wire serial interface module supports the communica- 
tion protocol for the registers of the KS0119 and KS0122. 
Video interface 252 also includes an interface to an external 
EPROM which is used to load in program data immediately 
after system reset, and is part of the boot initialization. The 
EPROM is memory mapped, with address ranges from 
COOOOh to DFFFFh. 

Video encoder interface 410 in video interface 252 has a 
base address CODEC_REQ0 equal to 04B0 OOOOh and 
extends to 04BF FFFFh. Table A.4 describes the registers of 
the video encoder interface. 
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TABLE A.4 



Video Encoder Register Address Map 



Onset 




(hex) 


Register Name 


0 


Frame size Register 


1 


ID 


2 


Control/DATA Byte 


3 


INDEX/DATA0 


4 


DATA1 


5 


DATA2 


6 


DATA3 


7 


Status Register 


8 


Read DATA Serial Interface 


9 


Read PROM Data 


A 


Logic Control Register 


B 


HS, VS polarity 


C 


HS offset 


D 


VS onset 
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Information from some or all of an ID register, a control 
register, an index/DATAO register, DATA1 register, DATA2 
register, and DATA3 register are sequentially sent to video 
encoder 130 to access registers of video encoder 130. The 
frame size register controls the frame size (i.e. which reg- 
ister's contents) are transmitted to video encoder 130. Frame 
sizes range from three (the ID register, the control register, 
and the index/DATAO register) to six bytes (the ID, control, 
index/DATAO, DATA1, DATA2, and DATA3 registers.) The 
chip ID Register contains the CODEC chip ID value and 
should contain 03H for writes to the KS0199 codec and 83H 
for a read. The control/data register indicates whether the 
following transmitted byte is an index or a data byte. For the 
KS0119, 08h means that the following byte is an index, and 
09h means that the following byte is data. INDEX/DATAO 
register contains the index value for the configuration reg- 
ister in video encoder 130 or the data byte DATAO, depend- 
ing on the value transmitted in the previous byte from the 
control data register. DATA1, DATA2, and DATA3 registers 
contain data to be written in the CODEC register, Index+1, 
Index+2, and Index+3 respectively. 

The logic control register for the video encoder interface 
contains the number of bits per pixel value, a mode bit 
indicating whether video encoder operates in overlay mode 
or video card emulation mode, and a bit DMAENA to enable 
or disable DMA channel 0. 

The HS and VS Polarity register defines the polarity of 
horizontal sync and vertical sync signal. A value of 0 is 
defined to be active low, and a value of 1 is defined to be 
active high. Bit <0> indicates vertical sync polarity. Bit <1> 
indicates horizontal sync polarity. The HS offset register 
indicates the offset to the active horizontal sync signal and 
is defined to be OOh. The VS offset register indicates the 
offset to the active vertical sync signal and is defined to be 
OOh. 

The status register contains a read flag indicating whether 
a read of the external codec is ready or busy, a write flag 
indicating whether a write to the external codec is ready or 
busy, and a FROM flag indicating whether a read of the 
external PROM is ready or busy. The read data serial 
interface register contains the valid data from the serial port 
after the read flag transitions from busy to ready state. The 
Read PROM Data register contains the valid PROM data if 
the PROM Flag is in the ready state. 

Video encoder 130 can be configured to operate in overlay 
mode or VGA emulation Mode. Setting of a bit in logic 
control register 504 controls the mode. In the overlay mode, 
a VGA card in the host system is required, but the monitor 
cable connects to the MSP card. MSP 200 creates multiple 
display buffers each the same size as the VGA settings. To 
create a video window, software should fill a color key area 
in the VGA frame buffer of the host system, and the video 
data in SDRAM 180 should be written into an area of the 
same size and at the same location as the area in the VGA 
Frame Buffer. Video encoder 130 recognizes the color key 
and switches from the VGA input port coupled to feature 
connector 120 to the video input port coupled to video 
interface 252. Software executed by MSP 200 sets the 
starting address for DMA channel 0 at the top left corner of 
an SDRAM video Output Buffer, the DMA record length is 
set according to the resolution set in the VGA card and the 
bits used per pixel in the video data (16 bit per pixel for 
YCrCb 4:2:2). 

Setting configuration registers in a KS0119 video encoder 
requires a minimum of two frames: a first frame to set the 
index of the configuration register, and a second frame for 
read or write the content of the register. All bytes required 
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for the frame are set before changing the frame size register. 
The following example is for the setting chroma key byte 0 
and byte 1 of a KS0119 configuration register (index 6Ah 
and 6Bh). ID register 507 is loaded with the value 03h for 

5 write to video encoder 130. Data/control register 508 is 
loaded with value 08h to indicate that the next byte is an 
index. Index/data register 509 is loaded with value 6 Ah (the 
index of the first register to be accessed). Finally, the frame 
size register is loaded with the value 83h (Frame size=»3 and 
serial access bit set). Serial interface state machine 570 
detects a match with the content of the frame size register 
and start sending the frame, also the write flag in the status 
register is set to the busy state. Software should check the 
flags in the status register before loading the next frame. 
When the flags are in the ready state then software can load 

15 control register 508 to indicate a data write, index/dataO 
register 509 and DATA1 register 510 with the chroma key 
bytes, and frame size register 506 with 84h for a four byte 
frame. 

Video decoder interface 420 has a base address equal to 
20 04C0 2000h and extends to 04C0 2FFFh. Table A.5 defines 
the register of video decoder interface 420. 

TABLE A.5 



Video Decoder Interface Registers 



40 



OfiEset 
(hex) 


Register Name 


0 


Frame Size Register 


1 


ID 


2 


Control/DATA Byte 


3 


INDEX/DATAO 


4 


DATA1 


5 


DATA2 


6 


DATA3 


7 


Reserved 


8 


Read DATA Serial Interface 


9 


Reserved 


A 


Logic Control Register 


B 


Reserved 


C 


Reserved 


D 


Reserved 


E 


Status Register 



The frame size register, ID register, control register, index/ 
dataO register, datal register, data2 register, and data3 reg- 
ister operate as described above in regard to video encoder 

45 interface 410. However, when accessing video decoder 110, 
ID register contain 04h for KS0122 write and 84h for 
KS0122 read, and the control/data register being OOh means 
the following byte is an index and lOh means that the 
following byte is data. 

50 The logic control register 505 indicates the pixel value 
format as follow: 00 4:2:2 format; 01 4:1:1 format; and 10 
CC1R656 format. Status register bit <0> is 0 to indicate and 
even field and 1 to indicate an odd field for the pixel values 
being transmitted. Status register bit <1> indicates VS 

55 Status: 0: VS from 1 to 0; and 1: VS from 0 to 1. 

The read data serial interface register contains the valid 
data from the serial port after the Read Flag has made the 
transition from Busy to Ready State. 
We claim: 

6 0 1- A video overlay process comprising: 

forming a first set of pixel values which represents a frame 
in a graphics image, wherein within the frame, one or 
more areas are represented by pixel values that have a 
key value; 

65 forming a second set of pixel values, wherein pixel values 
in the second set are in one-to-one correspondence with 
pixel values in the first set; and 
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generating a video signal from the pixel values, wherein 
generating the video signal comprises: 
encoding pixel values from the first set except the pixel 

values in the first set that have the key value; and 
encoding pixel values from the second set in place of 5 

the pixel values in the first set that have the key 

value. 

2. The process of claim 1, wherein the pixel values in the 
first set that have the key value represent a plurality of 
rectangular areas in the graphics image, and the pixel values 10 
in the second set that correspond to the pixel values having 
the key value represent a plurality of video images, wherein 
the plurality of video images are in one-to-one correspon- 
dence with the plurality of rectangular areas. 

3. The process of claim 1, wherein a device connected to 15 
a bus of a host computer forms the second set of pixel 
values, and the process comprises the host computer trans- 
mitting to the device, information indicating which pixel 
values in the first set are equal to the key value. 

4. The process of claim 3, wherein forming the second set 20 
of pixel values comprises forming a pixel map in a local 
memory of the device such that one or more blocks of pixel 
values which represent one or more video images are 
position in the pixel map at locations corresponding to the 
areas in the graphics image represented by pixel values 25 
having the key value. 

5. The process of claim 4, wherein forming the second set 
of pixel values comprises providing dummy values for pixel 
values in the second set which do not correspond to pixel 
values in the first set that have the key value. 30 

6. The process of claim 1, wherein encoding pixel values 
comprises: 

simultaneously transmitting to a video encoder a first 
pixel value from the first set and a second pixel value 
which is from the second set and corresponds to the first 35 
pixel value, wherein the video encoder performs steps 
including: 

determining whether the first pixel value has the key 
value; 

generating the video signal based on the first pixel 40 
value in response to determining the first pixel value 
does not have the key value; and 

generating the video signal based on the second pixel 
value in response to determining the first pixel value 
has the key value. 45 

7. The process of claim 1, wherein generating the video 
signal further comprises: 

sequentially transmitting the pixel values from the first set 
to a video encoder; 
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sequentially transmitting the pixel values from the second 
set to the video encoder, wherein each pixel value in the 
second set is transmitted to the video encoder simul- 
taneously with the corresponding value in the first set; 

for each pixel value in the first set, determining whether 
that pixel value has the key value; 

generating the video signal based on the pixel value from 
the first set in response to determining the pixel value 
does not have the key value; and 

generating the video signal based on the pixel value from 
the second set in response to determining the corre- 
sponding pixel value from the first set has the key 
value. 

8. A video overlay system comprising: 

a video encoder capable of alternative selecting a first 
input value and a second input value for generation of 
a video signal, wherein the first input value is selected 
unless the first input value has a key value; 

a source of pixel values representing a graphics image, 
wherein the source provides pixel values to the video 
encoder as the first input value; 

a buffer for a frame having dimensions corresponding to 
dimensions of the graphics image; and 

a video interface coupled to the buffer and the video 
encoder, wherein video interface transfers pixel values 
from the buffer to the video encoder as the second input 
value, wherein 

the source and the video interface are synchronized so that 
the video interface provides the pixel values from the 
buffer in a one-to-one correspondence with the pixel 
values from the source of video data. 

9. The overlay system of claim 8, wherein the video 
interface is coupled to receive a vertical synchronization 
signal from the video encoder, and the video interface begins 
transferring pixel values from the buffer in response to the 
vertical synchronization signal. 

10. The overlay system of claim 9, wherein the video 
interface is coupled to receive a horizontal synchronization 
signal from the video encoder, and the video interface begins 
transferring pixel values from a start of a row in the buffer 
in response to the horizontal synchronization signal. 

11. The overlay system of claim 8, further comprising: 
a signal processor which generates the pixel values stored 

in the buffer; and 
a direct memory access control which controls transfers of 
pixel values from the buffer to the video interface. 
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